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Introduction 


All  filters  in  radar  system  simulations  are  normally  assumed  to  be  at  steady  state  when 
subjected  to  deterministic  and  stochastic  signals  (the  transient  response  has  passed).  The 
simulation  usually  uses  some  multiple  of  the  step  time-response  constant  to  determine 
when  the  system  enters  steady  state.  This  report  shows  a  novel  way  to  determine  when 
steady  state  has  been  reached  when  subjected  to  stochastic  signals.  The  steady  state  is 
defined  as  when  the  variance  of  the  output  has  reached  95%  of  its  steady  state  value. 

The  description  of  the  transient  response  of  a  system  subjected  to  noise  is  found  in  the 
solution  for  the  probability  density  function  of  the  process  Vout(t)  described  by  the  stochastic 
differential  equation 

dnVout  c ?n_1Vr0«t  T  _  . 

^2 - ^  an- 1  dfn-l - ^  ■"  a° Vout  =  Vinif) 

where  the  forcing  function  Vjn(t)  is  any  stationary  stochastic  process. 

The  stochastic  differential  equation  under  this  general  forcing  function  does  not  have  a 
closed-form  solution.  As  in  most  cases,  to  make  the  solution  tractable,  we  assume  that  the 
forcing  function  is  a  Gaussian  distributed  (stationary)  stochastic  process. 


(1) 


2.  Theory 


The  transducer  function  H(s)  for  an  nth  order  low  pass  filter  in  the  s-domain  (1)  is 


Sn  +  CLn—iSn  1  +  ...  +  Oq 


(2) 


For  ease  of  analysis  we  set  the  term 


1.  Under  this  assumption,  equation  2 


represents  the  left  side  of  equation  1  in  the  s-domain. 


Assuming  Vin(t )  is  a  random  voltage  with  a  spectral  density  Wo(f)  =  Wo,  then  equation  1 
becomes  the  general  nth  order  equation  of  the  Langevin  type.  The  solution  for  the 
probability  density  function  for  Vout[t)  using  the  Fokker-Planck  equation  found  in  Risken 
(£)  is  difficult.  However,  D’Azzo  and  Houpis  ( 3 )  offer  a  closed-form  solution  to  the  problem 
if  we  convert  equation  1  into  an  equivalent  system  of  first-order  differential  equations. 
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In  order  to  use  the  solution  offered  by  D’Azzo  and  Houpis  (5)  (p.155),  we  transform  equation 
1  by  first  defining  the  operator  DJ  =  jh-,  and  then  dehning  the  phase  variables  in  terms  of 
this  operator  we  obtain 


*£i  Vout,  %2  k i  DVout,  •  ••,  xn  xn—i  D  Vout  (3) 

Using  the  phase  variables,  equation  1  can  be  written  as  a  system  of  N  first-order  differential 
equations. 
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From  Risken  (2)  (section  3.2),  equation  4  represents  an  Ornstein-Uhlenbeck  process  where 
the  £  variables  have  replaced  the  x  variables  and 
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(5) 


Letting  Vout(t )  have  a  zero-mean  value,  and  since  the  noise  is  white,  we  have  out{t)Vout{t '))  = 
D5[t  —  t')  for  the  correlation  function 
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(6) 
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where  D  is  the  power  spectral  noise  density  of  the  white  Gaussian  process  Vin(t). 

From  Risken  (2)  (p.153)  we  learn  that  the  drift  coefficient  is  linear  in  the  Ornstein-Uhlenbeck 
process.  Note  that  Risken  ( 2 )  uses  the  Einstein  summation  convention  for  the  Latin  indices 
but  not  for  Greek  indices.  We  will  do  the  same. 


A  =  -7 ijXj  (7) 

The  diffusion  coefficient  is  a  constant,  that  is 


7 ij,  Dij  =  Dji  (Constant  matrix)  (8) 

Following  Risken  (2),  for  the  derivation  of  the  solution  for  the  transition  probability  density, 
we  determine  the  complete  biorthogonal  set  for  the  7  matrix, 


with  the  orthonormality  and  completeness  relation 


(9) 
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(a)  (a) 
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fia/3 


(10) 


Such  a  complete  biorthogonal  set  exists  if  the  N  eigenvalues  are  all  different. 
The  spectral  decomposition  of  the  matrix  7  is 


7 ij 
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Using  Risken  (2)  (eq.  6.118)  for  the  matrix  o 


°rij{T)  =  2 Dks  ■  J  Gik(r')G js(r')dT'  (13) 

o 


we  obtain 


—  2 

a, 0 


2  _  g— (Act+A^t 

+  ^/3 


(14) 


where 


D{a’0)  =  (15) 

By  using  equations  7-14  and  performing  the  integration  (explained  in  Risken  ( 2 ),  section 
2.3.3),  we  arrive  at  the  expression  for  the  transition  probability  density  function 


P({x},t\{x'},t')  =  [Det  a(t  - 1')]  2  (16) 

ern  (  1  ~  ~  “  Gjk(t  ~  t')x'k\ 

To  solve  equation  16  in  closed-form  will  require  closed-form  solutions  for  the  eigenvalues  of 
7  and  for  the  inverse  of  the  a  matrix  (^).  Modern  symbolic  processors  can  accomplish  this, 
but  it  will  prove  very  difficult  for  a  symbolic  processor  to  integrate  out  the  (n  —  1)  variables 
to  obtain  the  probability  density  function  for  x.  If  this  closed-form  is  obtained,  an 
additional  integration  will  be  required  to  obtain  the  mean  and  variance  of  the  variable  x. 

Since  the  joint  probability  density  function  is  Gaussian,  the  mean,  variance,  and 
probability  density  function  can  be  obtained  from  the  characteristic  function.  Since  the  D 
matrix  contains  only  one  constant  element,  the  expressions  for  the  mean,  variance,  and 
probability  density  function  of  x  can  be  simplified. 

From  Middleton  (5)  (section  7.3)  we  see  that  the  mean  and  correlation  matrices  in  terms 
of  the  variables  in  Risken  ( 2 )  (eq  6.113)  for  the  characteristic  function  (keeping  with  the 
Einstein  summation  convention)  can  be  expressed  as  sums.  This  step  is  necessary  so  that 
symbolic  and  numerical  calculations  can  be  performed. 
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mean  =  M^t  —  t')  =  Gij{t  —  t')x'-  =  ^  e  Xatuf  } x'-  (17) 

a 

where  the  x'3  are  the  initial  conditions  for  the  random  variable  aq  ( at  t  =  t')  for  the  differential 
equation  for  the  probability  density  function  (Risken  (2)  (eqs.  16.108,  16.109). 


K  —  Gij  —  2 


!_e  (Aa+A  P)t,  \  (a)  f/3) 


a,  p 


Aa  +  A  g 


V’Dkiu 


■3  )Ui  V3 


Using  equation  17  we  obtain  for  the  mean  of  the  variable  X\ 


(18) 


N  N  N 

Mxi  ^  ^  G\ kXk  Xjtuipk3xk  (is) 

A;=l  k= 1  j= 1 

Using  equation  18  we  obtain  for  the  variance  of  variable  X\ 


Vari  =  ou(t)  =  2 - — 6  - (u^ DNtNu^A  u[a)uf}  (20) 

Aa  +  A/3  v  / 

a,p 

From  Middleton  (5  p.16)  we  have  the  result  that  the  marginal  characteristic  function  cor¬ 
responding  the  marginal  probability  density  function  for  X\  is  just  the  joint  characteristic 
function  with  all  the  ks,  except  k\  is  set  equal  to  zero.  Thus  the  marginal  characteristic 
function  for  aq  is 


mcfx  1  = 


(21) 


Taking  the  inverse  Fourier  transform  of  equation  19  we  obtain  the  marginal  probability 
density  function  for  the  variable  aq.  Using  the  fact  that  the  joint  probability  density 
function  is  Gaussian  and  the  properties  of  the  joint  characteristic  function,  we  can  obtain 
the  mean  and  variance  of  the  variable  aq  by  simple  summation,  and  the  marginal 
probability  density  function  by  a  single  one-dimensional  Fourier  transform. 


3.  Comparison  of  Simulation  and  Theoretical  Results 

To  compare  simulation  and  theoretical  results  of  the  means,  variances  and  marginal 
probability  density  function  for  the  variable  aq,  second-,  third-,  and  fourth-order 
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Butterworth  transfer  function  were  used.  The  3dB  cutoff  frequency  in  all  three  cases  was 
uj  =  1.  To  obtain  the  simulation  results,  4,000  representations  of  the  non-stationary 
stochastic  process  x\  were  generated.  The  value  of  D  used  was  2.5  and  the  initial  condition 
for  X\  was  2. 

A  relationship  between  the  value  of  D  used  in  the  theoretical  results  and  the  variance  of 
the  Gaussian  noise  source  used  in  the  simulation  has  to  be  established.  The  Dtheo  used  in 
the  theoretical  results  is  one  half  the  noise  density  obtained  by  dividing  the  total  power  by 
the  bandwidth.  The  noise  density  used  in  the  simulation  is  the  variance  (total  power)  of 
the  Gaussian  noise  generator  divided  by  the  simulation  bandwidth.  Thus,  the  simulation 
noise  density  is  ( DSim  —  crsirn)St ,  where  the  simulation  sample  time  is  St.  Since  the  two  D’s 
must  be  the  same,  we  have 


_  2  Dtheo 
CTsim  ~ 

Figures  1  and  2  show  the  analytical  and  simulated  results  for  the  mean  as  a  function  of 
time. 


Figure  1.  Analytical  results  for  the  means. 


Figure  2.  Simulation  results  for  the  means. 

Figure  1  shows  the  expected  result  that  the  transient  response  of  the  filter  increases  as  the 
order  of  the  filter  is  increased. 
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The  simulation  results  agree  with  the  theoretical  results.  Note  that  the  higher  the  order  of 
the  filter,  the  longer  it  takes  to  reach  steady  state.  In  order  to  simulate  the  initial  condition 
for  the  stochastic  variable  aq,  it  was  necessary  to  drive  the  filter  with  a  direct  current  (DC) 
voltage  equal  to  the  initial  condition  x[  and  then  let  the  output  of  the  filter  reach  the 
steady  state  value  x[.  When  steady  state  was  reached,  the  stationary  Gaussian  process  (D 
=  2.5)  was  applied  to  the  input  of  the  filter. 

To  show  just  how  close  the  simulation  was  to  theoretical  values,  the  simulation  results  are 
overlaid  the  theoretical  for  the  third  order  filter  in  figure  3.  The  simulation  results  are 
shifted  in  time  to  match  the  theoretical. 


Figure  3.  Comparisons  of  results  for  the  mean  for  the  third-order  Butterworth  filter 
response. 

Figures  4  and  5  show  the  analytical  and  simulation  results  for  the  variance  as  a  function  of 
time. 

Both  figures  4  and  5  show  that  as  the  order  of  the  filter  is  increased,  the  time  for  the 
variance  of  the  output  to  reach  steady  state  increases. 


Figure  4.  Analytical  results  for  the  variances. 
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Figure  5.  Simulation  results  for  the  variances. 

As  in  the  mean  calculations,  in  order  to  simulate  the  initial  condition  for  the  variable  xi, 
the  output  of  the  filter,  it  was  necessary  to  drive  the  filter  with  the  initial  condition  voltage 
and  let  it  stabilize  to  the  initial  condition.  Again,  at  the  stabilization  time  the  stationary 
Gaussian  process  (D  =  2.5)  was  applied. 

To  show  just  how  close  the  simulation  is  to  theoretical  values  of  settling  time  of  the 
variance,  the  simulation  results  for  the  third-order  filter  are  superimposed  on  the  analytical 
in  figure  6.  Again,  the  results  were  shifted  in  time  to  compare  the  simulation  against  the 
analytical  results. 


Figure  6.  Comparison  of  results  for  the  variances  for  the  third-order  Butterworth  filter 
response. 

Figure  6  shows  that  we  have  a  very  close  match  between  simulates  and  analytical  in  the 
transient  response  of  the  variance. 

Figure  7  shows  the  theoretical  probability  density  function  for  as  a  function  of  four  time 
values. 

Figure  8  shows  simulation  and  theoretical  results  for  the  probability  density  function  of  X\ 
for  two  values  of  time. 

Figure  8  shows  that  the  theoretical  and  simulation  histograms  are  in  good  agreement. 
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Figure  7.  Theoretical  probability  density  for  the  third-order  Butterworth  filter  response. 


Figure  8.  Theoretical  probability  density  and  simulation  for  the  third-order  Butterworth 
filter  response. 

Figure  9  shows  the  theoretical  step  response  and  variance  as  a  function  of  time  for  a 
third-order  Butterworth  filter.  The  step  response  is  amplitude  scaled  so  that  both  plots 
approach  the  same  steady  state  value. 


Figure  9.  Variance  of  the  step  function  input  response  of  a  third-order  Butterworth  filter. 
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Figure  9  shows  that  for  the  third-order  system  that  the  time  for  both  the  variance  and  step 
response  to  approach  steady  state  are  of  the  same  order.  This  is  important  because  we  see 
that  steady  state,  as  measured  by  the  variances,  is  reached  before  the  classic  definition  of 
steady  state  for  a  deterministic  input.  This  allows  the  step  response  for  complex  systems  to 
be  used  as  a  measure  of  the  transient  response  of  the  complex  system  to  stochastic 
processes. 

Does  this  hold  in  general?  Since  both  responses  are  control  by  the  eigenvalues,  a  heuristic 
argument  indicates  it  does.  A  mathematical  argument  will  have  to  wait  for  a  later  report. 


4.  Conclusions 

We  have  shown  that  the  simulation  and  predicted  results  are  in  very  close  agreement  with 
each  other  when  calculating  the  transient  response  of  a  stable  low  pass  filter  output.  The 
theory  shows  that  we  are  not  limited  to  this  case  only.  We  can  easily  create  unstable 
Gaussian  processes.  By  varying  the  initial  conditions  in  a  periodic  manner  we  can  create 
stable  and  unstable  periodic  Gaussian  processes  for  use  in  evaluating  communication  and 
radar  simulations. 

Soong  ( 6 )  shows  how  to  extend  the  results  of  this  report  to  the  case  where  the  processes 
are  not  white  noise  defined  by  Soong  (6).  equation  7.199. 


dY(t)  =  g(Y(t),t)dt  +  dB(t)  (23) 

The  limitation  of  this  analysis  is  in  not  showing  the  exact  relationship  between  the  step 
response  to  filters  described  by  equation  2  and  the  transient  response  of  the  variance  of  the 
output  for  this  class  of  filters.  This  is  needed  to  use  the  easily  obtained  step  response  as  an 
upper  bound  for  the  transient  of  the  variance  of  the  output  of  the  filter. 
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US  ARMY  RESEARCH  LAB  2 

AMSRD  Cl  OK  TP  TECHL  LIB 
ATTN  T  LANDFRIED 
APG  MD  21005 

US  ARMY  RESEARCH  LAB  1 

ATTN  AMSRD  MAILROOM  VAULT  R  REYNA 
BLDG  1624 

WSMRNM  88002-5513 

US  ARMY  RESEARCH  LAB  1 

AMSRD  ARL  SL 
ATTN  P  TANENBAUM 
APG  MD  21005 


US  ARMY  RESEARCH  LAB  1 

AMSRD  ARL  SL  E 
ATTN  R  FLORES 
BLDG  1624 

WSMRNM  88002-5513 

US  ARMY  RESEARCH  LAB  1 0 

ATTN  AMSRD  ARL  SL  ES 
J  GONZALEZ 
E  JACKSON 
G  VILLALVA 
R  VEGA 
J  BOEHM  (3) 

P  DEBROUX  (3) 

BLDG  1624 

WSMRNM  88002-5513 

US  ARMY  RESEARCH  LAB  1 

AMSRD  ARL  SL  EE 
ATTN  E  REDE 
BLDG  1624 

WSMRNM  88002-5513 

TOTAL  20 
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